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Abstract 

General characterizations of ergodic Markov chains have been developed in con- 
siderable detail. In this paper, we study the transience for discrete-time Markov 
chains on general state spaces, including the geometric transience and algebraic 
transience. Criteria are presented through establishing the drift condition and con- 
sidering the first return time. As an application, we give explicit criteria for the 
random walk on the half line and the skip-free chain on nonnegative integers. 
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1 Introduction 

In the past decades, great efforts have been made to study the ergodic theory for Markov 
chains. The drift condition (Foster-Lyapunov condition) is an important method, which 
has been used extensively. For example, Meyn and Tweedie [IB] gave drift conditions 
for geometric and uniform ergodicity. Tuominen and Tweedie [19] studied subgeometric 
ergodicity by using a sequence of drift conditions, which is a foundational work. Building 
on it, Jarner and Roberts [11] investigated polynomial ergodicity by establishing a single 
drift condition, and Mao [T3J E] used one drift condition to study the algebraic conver- 
gence and the ergodic degree. Then Douc, Fort, Moulines and Soulier [7] presented a new 
practical drift condition to prove subgeometric ergodicity. This condition, extending the 
condition introduced by Jarner and Roberts, turned out to be more convenient than that 
in Tuominen and Tweedie [19|. 

In this paper, we aim to investigate the transient theory for discrete-time Markov 
chains, which is also an interesting and challenging problem. The study of transient the- 
ory may be dated back to Harris [9] in the 1950s, who obtained a necessary condition 
and a sufficient condition for the existence of stationary measures for transient Markov 
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chains. The problem was further discussed by Vere- Jones j22j E3], who defined the geo- 
metric transience on the countable state space, and studied the A-subinvariant measure 
of geometrically transient Markov chains. For more details, one can refer to pQ. Then 
Vere- Jones's results were extended to chains with fixed absorbing points, see [5] and ref- 
erences within (if the absorption is reducible or not certain, see e.g. [SJ HE])- In [211 12"T] . 
Tweedie extended the results of Harris and Vere- Jones to the general state space. Based 
on these works, Meyn and Tweedie [17] systematically studied the stochastic stability of 
discrete-time Markov chains. In their book, they used the drift condition to study the 
criteria of transience, see [T71 Theorem 8.0.2]. Besides, the transient theory has a wide 
range of applications, see e.g. [U EJ IT2"] . 

However, in spite of these developments in both the drift condition of ergodicity and 
the transient theory, it seems that using drift conditions to study further transience of 
discrete-time Markov chains has not been fully revealed. The goal of this paper is therefore 



to study the geometric transience and algebraic transience (see Definitions 2.1 and 3.1 
below) of general discrete-time Markov chains, through establishing appropriate drift 
conditions. 

Let us introduce the basic setup of the paper. Let $ = {$„: n G Z + } be a discrete- 
time homogeneous Markov chain on a general state space X, endowed with a countably 
generated cx-field B(X). Denote by P n (x, A) the n-step transition kernel of the chain: 

P n (x, A) = P x {$ rt G A}, n G Z+, x G X, A G B(X), 

where F x is the conditional distribution of the chain given <3> — x - The corresponding 
expectation operator will be denoted E^. Here, P may be stochastic or sub-stochastic, 
and for all nonnegative measurable function /, 

P n f{x) = [ f(y)P n (x,dy), neZ + ,xeX. 
Jx 

Assume throughout the paper that the chain $ is ^-irreducible, where if) is a maximal 
irreducibility measure. Write B + (X) = {A G B(X) : if) (A) > 0} for the sets of positive 
■^-measure. 

For a probability distribution a = (a n ) n ^, let K a be the transition kernel given by 

oo 

K a (x, A) = a nP n {x, A), x G X, A G B(X). 

n=l 

A set A G B(X) is called petite if there exists a probability distribution a and a nontrivial 
measure v a such that 

K a (x,-)>u a (-), xeA. 

Petite sets are not rare: if $ is f/'-meducible, then for every B G B + (X), there exists a 
petite set A C B such that A G B + (X), see [T7J Theorem 5.2.2] for reference. 

The first return time of a set A G B(X) is denoted by ta = inf{n > 1 : $ n G A}, and 
the first hitting time is defined by a a = ta1{$ ^} = > : $„, G A}. They are two 

stopping times with respect to the filtration (J r n ), where T n — o {$ , • • • , $ n }- Let 

F n (x,A) =F x {t a = n}, n = l,2,-.. ,oo 
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be the distribution of ta., and 



L(x, A)=J2 Fn & A ) = < 00} 



n=l 



the probability of $ ever returning to A. 

Recall that the chain $ is transient if it is ^-irreducible and there exist sets Ai G 
B + (X), i = 1, 2, ■ ■ ■ such that 

00 00 
X = \jAi and sup ^2 P n (x, Ai) < 00, i > 1. (1.1) 

Moreover, according to the proof of [T7J Theorem 8.3.6], we can have 

Proposition 1.1. The chain $ is transient if and only if for every petite set B G B + (X), 
there exists a set A C B with ip(A) > such that 

sup L(x, A) < 1. 



For the transient chain, by (1.1), we have lim^oo P n (x, AA = for all x G A; t . Thus, 
it is natural to ask how fast P n (x,Ai) goes to zero. This is the main motivation for us 
to study further transience, which we specify to be geometric transience and algebraic 
transience. In the paper, we will give practical drift conditions for these transience, as 
have been done in the ergodic case. The basic idea is still to consider the first return 
time. Let us take as an example the comparison of geometric ergodicity and geometric 
transience. 

The chain $ is called geometrically ergodic if there exists a stationary distribution 7r 
satisfying 

I \P n (x, •) - tt|| < M(x)p n , n e Z+, x e X, 

for some M(x) < 00 and p < 1, where || • || is the total variation norm. For the ergodicity, 
Meyn and Tweedie \IT\ Chapter 15] have the following main results. 

Theorem 1.2. Suppose that the chain $ is ip -irreducible and aperiodic. Then the follow- 
ing statements are equivalent. 

(1) There exist some petite set A G B + {X) and k > 1 such that 

supE x [k ta ] < 00. (1.2) 

(2) There exist some petite set A G B + (X), constants b < 00, A < 1 and a function 
W > 1, with W(xo) < 00 for some Xo G X, satisfying the drift condition 

PW(x) < XW(x) + bl A {x), xeX. 

(3) The chain $ is geometrically ergodic. 



Note that L(x,A) = 1 for the ergodic Markov chain, we can rewrite (1.2) as 

sup L(x, A) = 1 and supE x . [k ta 1{ ta<00 }] < 00. (1.3) 
xeA xgA 
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As for the geometric transience, it shows in the following Theorem 2.2 that if (and only 
if) 



supL(x, A) < 1 and supE x [ 



K 



4ta<oo} 



]< 



OO, 



;i-4) 



then the chain $ is geometrically transient. Thus, from (1.3) and (1.4), it is natural to 
study F n (x,A) more carefully for the geometric transience. 

The remainder of the paper is organized as follows. The geometric transience, includ- 
ing strongly geometric transience and uniformly geometric transience are investigated in 
Section |2j Section [3] is devoted to researching the algebraic transience. In Section |4| we 
apply our results to the random walk on IR + and the skip-free chain on Z + . 



2 Geometric transience 

In this section, we will study three kinds of geometric transience. 



2.1 Geometric transience 

We begin with the definition of geometric transience. 

Definition 2.1. A set A G B + (X) is called uniformly geometric transient if there exists 
a constant k > 1 such that 

oo 

sup VVP n (:r,v4) < OO. 

X&A n=l 

The chain $ is called geometrically transient if it is ip -irreducible and X can be covered 
ip-a.e. by a countable number of uniformly geometric transient sets. That is, there exist 
sets D and Ai, % — 1, 2, • • • such that X = DU (U^i Ai)> where ip(D) = and each A{ is 
uniformly geometric transient. 

For the geometric transience, we have the following main result linking the "local" ge- 
ometric transience, the first return time, the drift condition and the geometric transience. 

Theorem 2.2. Suppose that the chain $ is ip -irreducible. Then the following statements 
are equivalent. 

(1) There exist some set A e B + (X) and k > 1 such that 

oo 

swpy^ j K n P n (x,A) < OO. 

x&A \ 
n=l 

(2) There exist some set A G B + (X) and k > 1 such that 

supE^ [k t - a 1 {ta<oo} ] < 1. (2.1) 

x£A 

(3) There exist some set A G B + {X) and k > 1 such that 

supL(x,A) < 1, supEa, [k ta 1 {ta<oo} ] < oo. 

xeA x&A 
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(4) There exist some set A G B + (X), constants b, A G (0, 1), and a function W > 1a, 
with W(xq) < oo for some xq G X, satisfying the drift condition 

PW(x) < XW(x)l A c(x) + bl A (x), xeX. (2.2) 

(5) The chain $ is geometrically transient. 

Remark 2.3. (1) According to the proof of (5) =>• (3), the set A G B + (X) is a petite set. 

(2) Since PW(x) < b holds for x G A with b G (0, 1), the set {x G A c : W(x) < 1} ^ 
u>/ien P zs stochastic. 

In order to prove the theorem, we need three lemmas. Let A be the family of increasing 
functions r: Z + — > [l,oo) satisfying 

r(0) = 1 and rim + n) < r(m)r(n), m, n G Z + . 

The next lemma is a straightforward generalization of [201 Proposition 2.1]. 

Lemma 2.4. Let r G A. 

(1) Assume that there exists a set A G snc/i that 

oo 

r(n)P n (x, A) < oo, £ G A 

n=l 

T/ien t/iere exist sets P and A i} i = 1, 2, • • • snc/j t/iat X = D U (U^li ^(-^) = 0; anc ^ 

oo 

sup ^2 r (n) P n (x, Ai) < oo, i > 1. 

zS^-i n=l 

(2) Assume that there exists a set A G £> + (X) swc/i t/iat 



sup r(n)P n (x, A) < oo. 

71=1 

JTien t/iere exist sets Ai, i = 1, 2, • • • st/c/j t/iat X = U^i Ai, and 



sup 

n=l 



^2r(n)P n (x,Ai) < oo, i > 1. 



Proof. We only prove the first assertion, since the proof of the second one is similar, 
(a) Set D = {x G X : Y^=i r(n)P n (x, A) = oo}. Since r is increasing, 



r(m + n)P m+n (x,A) > / P m (x, dy)r(n)P n (y, A), m,neN. 

J D 

Summing over n gives 

oo „ oo 

oo > ^r{n)P n {x,A) > / P m (x, dy) ^r(n)P n (y, A), x G A, 

n=l ^ D n=l 
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which means P m (x,D) = for m G N. Then ip{D) = by the ^-irreducibility. 

(b) For n, j G N, set 

H(n,j) = {xeD c : P n (x, A) G ((j + l)" 1 ^- 1 ] , A) = 0, k = 1, 2, • • • , n - 1} . 
Then D c = Un°j=i H(n,j) by the ^-irreducibility. Using rim + n) > r(n) again, we have 

r(m + n)P m+n (x,A) > [ r{m)P n (y, A)P m (x, dy) > (j + l)- 1 r{m)P m {x, H(n, j)). 

JH(n,j) 

Summing over m gives 

oo oo 

^r{m)P m {x,A) > (j + l)- 1 ^r{m)P m {x,H(n,j)). 

m=l m=l 

Hence ^'^ir(rn)P m (x, H(n, j)) < oo for x G D c . 

(c) For keN, let 

B(n,j,k) = IxE H(n,j) : ^r(m)P m (x, H(n, j)) < k 1 . 



m=l 

IOC' 



Then it is obvious that H(n,j) = \J^ =1 B(n, j,k). Combining this with (a) and (b), we 
have X = D U (lQ, fe =i B{n,j, fc)) , VP) = and 

oo 

sup r(jn)P m (x, B(n,j, k)) < oo, n, j, fc G N, 

xeB(n,j,k) m=1 

which yields the desired conclusion. □ 
Corollary 2.5. //$ geometrically transient, then it is transient. 



Proof. Suppose that $ is geometrically transient. Then by Definition 2.1, there exist 
A G B + (X) and k > 1 such that 



sup K n P n (x, A) < oo, 



71=1 



which implies sup xgj4 J^^^ P n (x, A) < oo. Thus, according to the first entrance decom- 
position, for all x G X, 



oo n— 1 



Y,P n ^,A) = Y,F n (x,A) + Y,Y, I P n ' m (y,A)F m (x,dy) 

n=l n=l n=l m=l ^ 

» oo 

= L(x,A)+ / Y^P n {y,A)L{x,dy) 



< i + su P Vr(2/,4 

n=l 



That is, sup^g^ Sn=i P n {, x t -<4) < °°- Hence the chain is transient from Lemma |2.4[ 2) by 
letting r(n) = 1. □ 
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We next give the condition on the first return time which ensures that a set is uniformly 
geometric transient. 

Lemma 2.6. Let A G B + (X) and k > 1. Suppose that there exists a constant e G (0, 1) 
such that 

CO 

^2 K n F n (x, A) < e, xeA. 

n=l 

Then we have 



J2K n P n {x,A) < xeA. 



n=l 



Proof. For A G B + (X), the last exit decomposition can be written as 

n— 1 „ 

P n (x, A) = F n (x, + pm ( x , dy)F n - m (y, A), neN. 



(2.3) 



For fixed N G N, multiplying by K n in (2.3) and summing n from 1 to N, we obtain 



N N N u-1 



J2K n P n (XiA) = J2K n F n (x } A) + Y,Yl I K m P m (x,dy)K n - m F n - m (y,A) 

ri=l n=l n=l m=l 

N „ iV-1 N—m 

n=l ^ m=l ?i=l 



i'V 



<£ + £^VP n (x,,4). 



n=l 



That is, J2n=i Kn P n (%, ^4) < jz^> which yields the assertion by letting N — > oo. □ 

To investigate the drift condition for the geometric transience, we will use the well- 
known minimal nonnegative solution theory, which is an important tool to study the 
recurrence and transience. For more details, one can refer to [21 [TO] . 

Lemma 2.7. For r G A, set r(n) = J2k=o r ( k )- Let A e B + (X). Then g*(x) := 
E x [r{r A )l {TA 

<oo}] is the minimal nonnegative solution of the equation 

9{x)= f g(y)P(x,dy) + P(x,A)+E x [rir A )l {TA<oo} ], x G X. (2.4) 



Proof. We will use the second successive approximation scheme of the minimal nonnega- 
tive solution [21 [10] . Let 

g W(x) = P( X ,A) + r(l)F 1 (x,A), x G X, 

and inductively 

g^ n+1 \x) = [ g {n) (y)P(x,dy) + r(n + l)F n+1 (x,A), n > 1. 



Then we have 

g w (x) = r(l)F 1 (x,A). 
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Assume that g^ n \x) = r(n)F n (x, A). Then 



= / r(n)F n (y, A)P(x, dy) + r(n + l)F n+1 (x, A) 

r(n)F n+1 (x, A) + r{n + l)F n+1 (x, A) 
r(n + l)F n+1 (x,A). 



Hence 

oo oo 



g*(x) = $><»>(*) = J2r(n)F n (x,A) = E x [?(t a )1 {ta<oo} 

n=l n=l 



is the minimal nonnegative solution of equation (2.4). □ 
Corollary 2.8. (1) For A G B + (X) and re > 1, 



E x [k ta 1 {ta<oo} ] = re / E y [k ta 1 {ta<oo} ] P( 
Ja c 



x,dy) + KP(x,A). (2.5) 

Moreover, {E x [k (TA 1{ cta <oo}\ , x G X} is the minimal nonnegative solution of the equations 

j g(x) = Kj Ac g(y)P(x,dy) + kP(x,A), x G A c ; 

\ g(x) = 1, xeA. { 0) 

(2) For Ae B + {X) and i G N, 

E x [{t a + l) e l {TA<oo} ] = [ E y [( t a + l) £ l{r A <oo } ] P(x, dy) 

^ n\ (2 - 7) 

+ P(x,A)+J2[ .je. Bwj- 

Moreover, {E x Ucr A + 1) £ 1{ CT4<00 }] , x G X} £/ie minimal nonnegative solution of the 
equations 



g(x) = f Ac g{y)P{x,dy) + P(x,A) + £i= ©E x [t*1 {ta<oo} ] , x G A c 
<?(:r) = 1, x G A. 



(2- 



Proof. (1) Set r(n) = re n with re > 1 in Lemma 2.7 Then 

r(0)=f(0) = l, r(n) = re n - re™" 1 , n>l. 

Hence 



[k ta 1 {ta<oo} ] = [ E y [k ta 1 {ta<oo} ] P(x,dy) 

+ P(X, A) + E x [(k Ta - K^- 1 ) l {TA< oo}] ■ 



Thus, (2.5) holds by rearranging terms. Moreover, by the localization theorem and the 



comparison theorem of the minimal nonnegative solution (see [21 Chapter 2]), the minimal 



nonnegative solution of equations (2.6) is \ E X [K aA l^ aA<00 y\ , x G Xj. 



(2) Set r(n) = (n + 1) in Lemma 2.7 The proof is similar to that of (1), is then 



omitted. □ 
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Now, we are ready to prove Theorem |2.2 



Proof of Theorem^ We prove first (3) => (2) (1) => (5) => (3), and then (2) (4). 

(3) =>- (2). Since sup^^P,; [k t ' 4 1{ ta<00 }] < oo, we have for all 5 > 0, there exists N 
large enough such that 



sup K n F n (x,A) <5/2. (2.9) 

xeA n=N +l 

Moreover, since sup x . gj4 L(x, A) < 1, there exists a constant A > 1 satisfying 



N 



sup 



(2.10) 



71=1 



Set K = minjfi;, A}. Then combining (2.9) with (2.10), we have 



oo Nq oo 

sup^£ n P n (x,A) < sup^A n P n (x,A) + sup K n F n (x,A) < 1 — 5/2 < 1. 



n=l 



n=l 



n=N +l 



(2) =>- (1) and (1) =>- (5) follow from Lemmas 2.6 and 2.4[ 1), respectively. 
(5) =>- (3). Suppose that <J> is geometrically transient. Then there exist B £ i3 + (X) 
and /t > 1 such that 



sup 



^VP n (x,P) < oo. 



(2.11) 



n=l 



Since P £ B + (X), it follows from Corollary 2.5 and Proposition |1.1| that there exists a 
petite set A C 5 with i/j(A) > such that 

supL(x, A) < 1. 

On the other hand, noting that A C B and P n (:r,A) < P n (x,A) for all a; £ X, we get 
from (12. 1 lh that 



sup K n F n (x, A) < sup K n P n {x, A) < sup K n P n {x, B) < oo 



x£A 



n=l 



x£A 



n=l 



x£B 



n=l 



(4) (2). If (Q holds with A = X, then P(;r, X) < PW(x) < b for x £ X, hence 
for 1 < n < ft -1 , 

supE a . [ft rx l{ Tx<0O }] = sup/€P(x,X) < ac6 < 1. 



Suppose that (2.2) holds with A ^ X and b < \. Then W satisfies 

W(ar) > A^PW^x) > A" 1 J Ac W(y)P(x } dy) + A^P^, A), x £ A c ; 
W(a;) > 1, ' x E A. 

According to ( 2.6[ ), the minimal nonnegative solution of the inequalities is given by 
{(7 A <oo}\ ! hence 

[A~ CT - 4 l {(TA<oo} ] < W{x), x £ A c . 
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Combining this inequality with (2.5), and noting that PW(x) < b < A for x G A, we 
obtain that for x G A, 

E x [A^1 {t4<oo} ] = A" 1 / E y [\- aA l {aA<oo} ] P{x, dy) + A^Pfo A) 
< X- 1 [ W{y)P{x, dy) + X~ l P{x, A) 



< A" 1 



- / W(y)P(x,dy) + b 



+ \- 1 P(x,A) 



< X^b < 1. 



Thus, (2.1) holds with k = X 1 . 

If A < b < 1, then there exists £ > such that A < b + e < 1, and satisfies 

> (6 + e)~ 1 PW(x) > (6 + e)" 1 f Ae W(y)P(x, dy) + (6 + e)~ 1 P(a;, A), x G A c ; 

> 1, " xeA. 



Using a similar argument, we have 



E x [(b + 



L {(T A <00} 



] < W(x) 



x e A c 



and for x £ A, 



E x [(b 



-TA 



l{r A <oo } ] = (b + s)- 1 [ E y [(& + £ )-^l w<oo} ] 
+ (6 + £ )- 1 P(x,A) 

< (6 + e)- 1 / W(y)P(x, dy) + (b + e)- % P(x, A) 



< (b + e)- 1 



- / W(y)P(x,dy)+b 



+ (b + e)~ l P{x,A) 



= (6 + e)- 1 6< 1. 

Then gj) holds with k = (6 + e) -1 . 

(2) (4). Set W(ar) = E x [/^l w<oo} ] for xGl. Then by Corollary Ql), 

= k _1 W(x), x G A c , 



and 



PW(x) = k~^E x [k ta 1 {ta<oo} ] < k 1 sxtpE x [k ta 1 {ta<oo} ] , xeA. 



Thus, (2.2) holds with A = k 1 and b = k 1 sup^^E-j, [k ta 1{ ta<00 }] . 



□ 



In the drift condition (2.2), we require that PW(x) < b < 1 for all x G A, which is 
sometimes difficult to apply. Hence we provide the following more practical drift condition. 
(GT) There exist some petite set A G B + (X), a constant A G (0, 1), a nonnegative 
function W(x) < 1 for and W(x) > 1 for satisfying the drift 

condition 

PW(x) < XW(x), x G A c . 

In Remark 2.3[ 2), we point out that if the drift condition (2.2) holds with a stochastic 
transition kernel P, then {x G A c : W(x) < 1} ^ 0. Here, we strengthen the condition as 
W(x) < 1 for all x G A c . 
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Theorem 2.9. Suppose that $ is a if) -irreducible chain. If condition (GT) holds, then $ 
is geometrically transient. 

Proof. Suppose that (GT) holds. Then we have 

PW{x) < XW{x), x e A c ; 
W(x) > 1, x E A. 



Thus, by Corollary |2.8[ 1), we get for x 6 A c , 

E x [\- TA l {TA<oo} ] < W(x) < 1. 

Hence 



(2.12) 



L(x, A) < E x [\- TA l {TA<oo} ] < 1, x e A c 



L(x,A)= L(y,A)P(x,dy) + P(x,A)<l, x e A. 



and 



Then there exist 5 < 1 and B C A with ip{B) > such that L(x, B) < 5 for all x G B. 
That is, 



supL(x, B) < 1. 



(2.13) 



On the other hand, by (2.12), we have 



E x [\- TA l {TA<oo} ] = A" 1 / E y [\- TA l {TA<oo} ] P(x,dy) + \~ 1 P(x, A) 

J A c 

<\- l P{x,A c ) + \- l P{x,A)<\-\ xeA. 



That is, 



supE-r [A TA l{ rA <oo}] =: b < oo. 



(2.14) 



In the following, we will prove that for some r > 1, 

supE x [r TB l {TB<oo} ] < oo. 

x&B 



This together with (2.13) yields the desired assertion. The proof can be divided into three 
steps. 



(a) First, we prove 



sup E x 



ta — 1 oo 

J2r k J2^ n F n (®k,A) 

. k=0 n=l 



< oo, 1 < r < A 



-i 



Set 



J2Z^- n F n (x,A), xeA c ; 

l, x e A. 



(2.15) 



(2.16) 



Then / satisfies 



Pf(x) = Xf(x)l A c(x) +\J2\- n F n (x,A)l A [ 



x 



n=l 



< r-ifWUcix) - ef{x)l A c(x) + Xbl A (x), 
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for all x G X and 1 < r < A , where e = r 1 — A. By defining Z k = r k f(§ k ) for k G Z H 
it follows that 

E[Z k+1 \T k ]=r k+1 E[f(<l> k+1 )\T k ] 

< r k+1 [r" 1 /^)^^) - e/($ fc )M$fc) + A61 A ($ A 

< Z fc - CT fe+1 /($ fc )Uc($ fe ) + \br k+l l A ^ k ). 

Then by [HI Proposition 11.3.2], for all C G B + (X), 



E, 



Vcr-l 

^er fc+1 /(^fc)lA«=(^ 

. k=0 



< Z n (x)+E a 



T£ — l 

£ A6r fc+1 U($ A 

. fc=0 



Multiplying by e l r 1 and noting that Z (x) = f(x), we obtain that 



E, 



Vcr—l 

£ r*/($ fc )Uc($») 

, fc=0 



< e-V -1 /^) + e _1 A6E a 



Vc— 1 



£ r fc l A ($ A 



fc=0 



which yields that 



E, 



TA-l 
. k=0 



< e- l r- 1 f{x)+e- l \bl A {x). 



Thus, by (2.16), 



sup E x 



ta — 1 oo 



fc=l n=l 



< £ V 1 + £ X A6 < OO. 



Combining this with (2.14), we get (2.15). 

(b) Noting that A is petite, according to (2.15) and the proof of [T71 Theorem 15.2.1], 
we obtain 

TQ — 1 OO 

£V£A- n F n ($ fe ,A) 

. fe = 71=1 

(c) For all C G B + (X), by the Markov property and noting that A < 1, we have 



sup E x 



< oo, C G 



E, 



E 



E 



E 



E 7 



T"cf — 1 OO 

k=0 n=l 
tc— 1 

£ r fe E #fe l {rA<oo} 
fc=o _ Lfc=o 

oo 

£r fc l {rc .> fc+1} E (l {e fc TA<oo} |J : ' fc ) 

fc=0 

oo 

£V fc E (l{ Tc .>fc+l}l{e fc r A <oo}l^ : fc) 
fc=0 



T"C — 1 OO 

J> fc 5>«($ fc ,A) 

fc = 71=1 



£ ^ fc l{r c >fc+l} E <I»fcl{rA<oo} 



E 3 



E x 



y^r fc l{ T - c .> fc+ i}l|gfc TA<00 | 

k=0 

TC-1 

^ r fc l{ 6 ,fe T4<oc } 



fc=0 
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where 9 is the usual shift operator. It follows from (b) that 

< oo, C e B + (X). 



sup K x 



TC — l 

^ rkl {e k r A <^} 

. k=0 



Noting that B c A, we arrive at 

"tb-1 



SUp Ea; 



7 j rk t{e k r B <oo} 

k=0 



SUp Ea; 



TB-l 

rfc l{r s <oo} 

, fc=0 



< OO, 



which yields that 



supE z [r TB l {TB<oc} ] < oo. 

x&B 



□ 



2.2 Strongly geometric transience 

In the previous section, we considered the geometric transience which satisfies 

oo 

sup^ K n P n (x, A) < OO, 



x£A 



n=l 



for some A e B + (X) and k > 1. However, in practice, there exist a great deal of 
chains with sub-stochastic transition kernel, for which we can further study the strongly 
geometric transience. 

Definition 2.10. The chain <3> is called strongly geometric transient if there exists a 
constant k > 1 such that 



^K n P"(x,X) < oo, xeX. 



(2.17) 



71=1 



Suppose that ( |2T7) holds and set A; = {x G X : £~ =1 K n P n (a;,X) < i} for i e N. 
Then we have 

oo oo 

X = yAi and sup ^VP™^,^) < oo, i > 1. 



8=1 



n=l 



This implies that if $ is strongly geometric transient, it is geometrically transient. For 
the converse, let P = {j>ij) be a transition kernel on X = N with 



P 



/ 7i \ 

& 72 

A» 73 

V ; ; : ; ••. j 



(2.18) 



If 7i = 1, 7^ = (k — l)/k and j3k = 4 fc for k >2, then the chain is geometrically transient 
but not strongly geometric transient by Theorems |2.2| (2) and 2.11[ 2), respectively. 
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Since the transition kernel of strongly geometric transient chain is sub-stochastic, there 
is a positive probability that the chain can "escape" from X. Let 



t = sup{n > : $„ G X}. 
Then for all bounded measurable function / on X, 

P n f(x)=E x [f^ n )l {T>n} ], xex. 
For the strongly geometric transience, we have the following criteria. 



(2.19) 



(2.20) 



Theorem 2.11. Assume that $ is ip -irreducible, and F x {r < oo} = 1 for all x G X. 
Then the following statements are equivalent. 

(1) The chain $ is strongly geometric transient. 

(2) For x G X, there exists a constant k > 1 such that E x [k t ] < oo. 

(3) There exist some constant A G (0, 1) and a finite function W > 1 such that 



PW{x) < XW{x), xeX. 



(2.21) 



Proof. (1) =>- (2). Suppose that (2.17) holds. According to (2.20), we have 

P n (x,X) = sup P n f(x) = sup E x [/($„) l {r>n} ] = F x {t >n}, x G X. 
I/I<1 l/l<i 

Hence for x G X, 



E x [k t ] = (k - 1) K m F x {r > m} + 1 

m=0 

oo 

= (k - 1) K m P m (x, X) + 1< oo. 



m=0 



(2) =>- (3). Denote by X = X U {9} the one point compactification of X. Let 
B(X) = a(B(X)U{d}), and 



P(x, A) 



P(x,A), x e X, Ae B(X); 

l-P(x,X), x e X, Ae B(X)\B(X); 

1, x G {9}, A G £>(X) \ B(X); 

0, x G {9}, A G £(X). 



Then P is a stochastic transition kernel. For x G X and ft > 1, set 

L?(x) = [k t ] l {xeX } + l{xe{d}}- 



Then by Corollary 2.8 1), W satisfies 



PW(x) = k~ 1 W(x), x G X; 
W({d}) = 1. 



14 



Let W{x) = W{x) for x EX. Then W > 1 and 



K -^W(x)= / W(y)P(x,dy)+ / W(y)P(x,dy) 

Jx J{d} 



X 



W(y)P(x, dy) + P(x, {d}) > PW(x) 
which finishes the proof by letting A = /c -1 . 



(3) =>■ (1). Iterating the inequality (2.21) and noting that W > 1, we have 



P n (x,X) < P n W(x) < A n W(a;), n>\. 
Thus, (1) holds with 1 < « < A -1 . □ 

In the next, we will study the V^-uniform transience for all function V > 1, which is 
closely related to the strongly geometric transience. 

Definition 2.12. The chain $ is called V-uniformly transient for V > 1, if 

P n V(x) 

||P n || v :=sup rV^O, n^oo. (2.22) 

xex V(x) 

Since || • ||y is an operator norm, ||P m+n ||y < | \P m \ \y\ \P n \ \v for m, n E Thus, 



the convergence rate in (2.22) must be geometric 



Theorem 2.13. Assume that $ is a ip -irreducible chain. Then the following statements 
are equivalent. 

(1) The chain $ is V-uniformly transient for some V > 1. 

(2) There exist some constant A G (0, 1) and a finite function W > 1 sitc/i i/iai 

Piy(x) < XW{x), x G X, 
where W is equivalent to V in the sense that c~ l V < W < cV for some c > 1. 

Proof. (1) =>- (2). Suppose that there exist constants R < oo and p < 1 such that 
< Pp n fo r ^ > 0. Then since p < 1, there exists no € M large enough such that 
Rp no < for some (3 > 1. Set 



np-l 
i=0 



Then noting that P n V(x) < Rp n V(x), we have 

V(x) < W(x) < ^Rp l V{x) < f3n RV(x), x G X. 

i=0 
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Moreover, in view of Rp n ° < (3 1 , we get 

no— 1 no 



PW(x) = P^P l+1 V(x) = ^2^P i V{x) 

i=0 i=l 
no — 1 

i=i 

no — 1 

i=i 

np— 1 

< /?~^ X /^P^W + P~^V{x) = 0~^W(x), 



i=i 



which yields the conclusion by letting A = (3 ™o . 

(2) =>■ (1). Since P n W < X n W and crV < W < cV, we obtain that 



cP n W(x) 



x&x c W(x) 



< c 2 A n 0, n -> cx). 



□ 



2.3 Uniformly geometric transience 

In this section, we will study a stronger type of geometric transience, which the conver- 



gence in (2.17) is uniform with respect to initial states.. 



Definition 2.14. The chain <3? is called uniformly geometric transient if there exists a 
constant K > 1 such that 

oo 

sup V K n P n (x, X) < oo. (2.23) 

Obviously, uniformly geometric transient chains are strongly geometric transient, but 
not conversely. In fact, let P = be a random walk on Z + with Pjj+i = p, Vj,j-\ — ^~P 
and pjj = for j > 0. If p < 1/2, then it is strongly geometric transient but not uniformly 
geometric transient according to Theorems 2.11| (2) and 2.15| (5), respectively. 



Let t be defined by (2.19). Then for the uniformly geometric transience, we obtain 
the following results. 

Theorem 2.15. Assume that $ is ip -irreducible, and F x {r < oo} = 1 for all x G X. 
Then the following statements are equivalent. 

(1) The chain is uniformly geometric transient. 

(2) There exists a constant k > 1 such that sup.j, gX E x [n T ] < oo. 

(3) There exists some constant X G (0,1) and a bounded function W > 1 such that 
PW(x) < XW(x) forxe X. 

(4) There exists some n G N such that sup,j. eX P n °(x,X) < 1. 

(5) sup x€X E x r < oo. 
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Proof. The proof of (1) <^ (2) <^ (3) is similar to that of Theorem 2.11 Thus, we only 
prove (1) (4) and (2) <^> (5). 

(1) => (4). Set M = sup xeX J2™=i K n P n (x,X). Then we have 

sup P n (x,X) < K~ n M, nGN. 
xex 

Since k > 1, there exists n$ large enough such that k,~ u °M < 1, which implies (4) holds. 
(4) =>• (1). Set 6 = sup xeX P n °(x,X). Then it is easy to obtain that 

sup P kno (x, X)<5 k , keN. (2.24) 

x&X 

For n G N, write n = kn + s, where k is the integer part of n/n Q and < s < n . Then 



by 02.24), 

P n (s,X)= / P kno (y,X)P s (x,dy) 
Jx 



< supP hn °(y,X)P s (x,X) <5 k < 5~ 
yex 



Thus, ( |2.23[ ) holds with 1 < k < 5- 1/n °. This proves (1). 

(2) <=> (5). Set M — sup^gjf E x t. Then by the minimal nonnegative solution theory 
(cf. [TUl Theorem 6.3.4]), we have 

sup E x [r n ] < n\M n . 
xex 

Hence for 1 < k < e 1/M , 

log k E x t < E x [k t ] = E x [e TlogK ] 

oo 

= ^(n!)- 1 (log«;)"E x H 

n=0 

oo 

< ^(log«) n M n = (1 — M log n) 1 , 

n=0 

which completes the proof. □ 

3 Algebraic transience 

In this section, we will study algebraic transience. First, let us begin with the definition. 
Definition 3.1. For an integer £ >1, a set A e B + (X) is called uniformly t-transient if 

oo 

supy\fP n (x, A) < oo. 
xeA \ 

n=l 

The chain $ is called l-transient if it is ^-irreducible and X can be covered ip-a.e. by a 
countable number of uniformly l-transient sets. 
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Similarly, if $ is algebraically transient, then it is transient. Since Hindoo K n /n e = oo 
for k > 1 and £ > 1, geometrically transient chains are algebraically transient, but 
not conversely. Let P = (p^) be defined by (2.18) with 71 = 1, 7^ = (k — l)/k and 
Ac = (k — l)/k^ for k > 2 and some integer £ > 3. Then the chain is algebraically 
transient, but it is not geometrically transient. 

For the algebraic transience, we have the following criteria connecting the "local" 
algebraic transience, the first return, the drift condition and the algebraic transience. 

Theorem 3.2. Let £ > 1 be an integer. Suppose that the chain $ is ip -irreducible. Then 
the following statements are equivalent. 

(1) There exists a set A £ B + (X) such that 



snpy^ j n e P n (x,A) < 00. 



n=l 



(2) There exists a set A £ B + (X) such that 



supLO, A) < 1, supE^ [r^l{ TA<0O }] < 00. 



(3.1) 



(3) There exist some set A £ B + (X), constants d £ (0, 00) , b £ (0, 1), and nonnegative 
functions W i; i = 0, 1, • • • with Wi(x ) < 00 for some x £ X, satisfying for i = 



0,1,-.. ,£, 



PW, L {x) < Wi{x) -(£- i)W i+1 (x), x £ A c ; 

X £ A: 



Wi(x) > 1, 
PW (x) < d, 
PWAx) < b, 



x £ A; 
x £ A, 



(3.2) 



where We+i = 0. 

(4) The chain $ is l-transient. 

Remark 3.3. (1) The set A £ B + (X) is a petite set. 

(2) Since PW e (x) < b holds with b £ (0, 1) m fislfy , the set {x £ A c : W e (x) < 1} + 
when P is stochastic. 

To prove the theorem, we need the following lemma. It gives the condition on the first 
return time which ensures that a set is uniformly ^-transient. 

Lemma 3.4. Let A £ B + (X) and I £ N. Suppose that 

00 

supL(x, A) < 1, sup y2n e F n (x, A) < 00. 

n=l 

Then 

00 

sup^?/P w (x, A) < 00. 



n=l 
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Proof. Set 5 = sup xgj4 L(x, A) and M = sup x&A Y^=i n e F n (x, A). Then for fixed N eN, 
it follows from (2.3) and the binomial theorem that for x £ A, 



N n-1 



E n e P n (x, A) = J2 n e F n (x } A) + E E / pm ( x ' d v) Fn ~ m {v^ A W 

n=l n=l n=l m=l 

N „ N-1 N 

= ^n l F n {x,A) + / ^P m {x,dy) E F n ~ m {y, A){m + n - mf 

n=l ^ m=l n=m+l 

N . N-1 N-m 

= Y,n l F n {x,A)+ / J2 mepm (^ d y) E^'^ 

n=l A m=l n=l 

/N-1 N-m i-1 , „x „ N-1 N-m 

E P m (x, dy) Y, n e F n (y, ^) + E(j / E m ^ m (^> <*y) E A) 

L m=l n=l fc=l ^ ' A m=l n=l 



N N i-1 N 

< M + ^m'P m (i,A) + M^P ra (s,i) + M E LI E mfcpm ( x ' A )- 

m=l m=l fe=l m=l 



That is, for x G A 

A' 



N M \ N £_1 /A * 

E a) < — i + E pn (^) + E(jE nkpn ( x > A ) 

n=l _ n=l k=l ' n=l 



(3.3) 



On the other hand, by Lemma 2.6 we have 



71=1 



Then we get 



M 



J2nP n (x,A)< — 



n=l 



6 



l + J2P n (x,A) 



n=l 



< 



M 



x e A. 



Combining these two inequalities with (3.3), and by the induction argument, we complete 
the proof. 



□ 



Now, it is ready to prove Theorem |3.2[ 



Proof of Theorem \3.°/A (2) =>- (1) and (1) =>- (4) follow from Lemmas 3.4 and |2.4[1 



respectively. (4) =>- (2) is similar to (5) =>- (3) of Theorem 2.2 Thus, we need only prove 
(2)^(3). 

(3) =>• (2). If (3.2) holds with A = X, then the proof is similar to that of Theorem 



Suppose that (3.2) holds with A^ X. Then We satisfies 



W e (x) > PWe(x) > f Ac We(y)P(x, dy) + P(x, A), x G A c 
Wtlx) > 1, x G A. 



19 



According to (2.6), the minimal nonnegative solution of the inequalities is given by 
L(x, A)1ac(x) + Ia(x). Hence L(x, A) < We(x) for x G A c , and for x G A, 



L(x,A)= L(y,A)P(x,dy) + P(x,A) 

J A c 

< / W e (y)P(x,dy)+P(x,A) (3.4) 

J Ac 

< - / W e (y)P(x, dy) + b + P(x, A) < b. 

J A 

Since We-i(x) > 1 for x G A, we have 

Wi_i(x)>PWi_!(a:)+Wi(a;)> / W^_i(y)P(x, dy) + A) + W e (x), x e A c . 

Ja c 

Set i = 1 in (Q. Then it yields that 

oo „ oo 

Y^{n + l)F n {x,A)= I (n+ l)P n (?/, A)P(x, dy) + P(x, A) + L(x,A), i6#. 

n=l n=l 

Noting that L(a;, A) < W^(x) for a; G A c , it follows from the comparison theorem that, 

oo 

Y^{n + l)F n {x,A) < W e -i(x), xeA c . 

n=l 

Suppose that for all i < I — 1, 

oo 

J2(n + iyF n (x,A) < W t -i(x), xeA c . 

n=l 

Then 

E (fK WW*}] = EE (f)n fc P«(*,A) 

fc=0 ^ ' n=l fc=0 ^ ' (3 5) 

<J2£(n + iy- 1 F n (x,A)<£W 1 (x), x G A c . 

n=l 

Since Wo (a;) > 1 for x G A, we have 

Wo(x) > PWo(x) + e\Vi{x) > [ W {y)P{x, dy) + P{x, A) + iW^x), x G A c . 

Ja c 

Thus, combining this with ( |2.8[ ) and ( 3.5[ ), we have 

oo 

J2(n + lYF n {x,A) <W {x), xeA c . 

n=l 

Noting that PW (x) < d, it follows from ( |2?7j ) that for aj G A, 

oo „ oo 

£VF"(x,A) = / ^(n + l) £ P™(y,A)P(x,^)+P(x,A) 

n=l ^ n=l 

< I W {y)P{x,dy) + P(x,A) ( 3 - 6 ) 

< - I W {y)P{x, dy) + d + P(x, A) < d. 

J A 
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Thus, (2) holds by Q and JTl. 

(2) =>- (3). Suppose that (3.1) holds. For i = 0, 1, •••,£, set 

Wi(x) = (£-i)\E x [{a A + l)^l w<oo} ] , x G X. 



Then by Corollary |2.8[ 2) and noting that 

J2 (l)n k = (n + 1)* - n* > (n + 1) 

r — n V / 



fc=0 

we obtain that 



Wi(x)= / Wi(y)P(a;,di/) + (€-i)!P(x,A) 

J A c 

OO £— »— 1 r„ ,\ 

n=l fc=0 ^ ' 



> PWi(ar) + - i){£ - i - 1)! J^(n + l)' - * -1 ^^, A) 

n=l 

= J¥ i (i) + (i-i)% 1 (i), x6i c , 

» OO 

PW ( X )=£! / \2(n + l) e F n (y,A)P(x,dy) + £\P(x,A) 

J ^ n=l 

OO 

= £\ J2( n + l) e F n+1 {x, A) + £\P(x, A) 

n=l 

oo 

< £\ sup n e F n (x, A) < oo, x G A, 



n=l 



and 



PWi(s) = L(a?,A) < supL(x,^4) < 1, x e A. 



□ 



The drift conditions in Theorem |3.2| can be generated from two drift conditions by 
using the following lemma, which is just a modification of [HI Lemma 3.5]. 

Lemma 3.5. Suppose that there exist A G B + (X), constants d G [0, oo), a G (0,1), and 
a function V > 1 satisfying 

PV{x) < V(x) - dV a (x), x G A c . 

Then for every < r] < 1, 

PV n {x) < V n (x) - rjdV^-^x), x G A c . 

Theorem 3.6. Let I > 1 be an integer. Suppose that $ is ip -irreducible. Then $ is £- 
transient if there exist some set A G B + (X), constants d G (0, oo), b G (0, 1), non-negative 
functions V{x) > 1 for x G X , W(x) > 1 for x G A and W{x) < 1 for x G A c , satisfying 
for x G X , 

PV(x) < (V(x)-£V 1 - I e( x )j l A c(x) + dl A (x); 
PW{x) < W{x)l A c(x) + bl A {x). 
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Proof. By Lemma 3J5 we have 

PV^ix) < V x -t(x) - {l-i)V l -*r{x), x G A c , i = 0, 1, • • • ,£- 1. 
Set = vH for i = 0, 1, • • • , £-1, and W t = W. Then for x G A c and i = 0, 1, • • ■ , £-2, 

PW t (x) < W t (x) -(£- i)W i+1 (x), 
PW^ix) < W e ^(x) - 1 < W e ^(x) - W e (x), 

and 

PW e (x) < W t (x). 

For x G A, we get PWo(x) < d < oo and PWe(x) < b < 1. Thus, the drift conditions 



(3.2) hold, which imply the ^-transience. □ 



4 Applications 

This section is devoted to applying our results to the random walk on R + and the skip-free 
chain on Z + . 

4.1 The random walk on the half line 



In this section, we illustrate the applicability of the drift conditions (2.2) and (3.7) by the 
random walk on the half line. 

Example 4.1. (The random walk on the half line). Suppose that $ = {$ n : n G Z + } is 

defined by choosing an arbitrary distribution for $o and taking 

$ n+ i = ($„ + U n+1 ) + , neZ+, 

where (<3> n + U n+ i) + = max (0, $ n + U n+ \), and (U n ) is a sequence of i.i.d. random vari- 
ables taking values in R with 

r(-oo, x] = P (U < x) , xeR. 

We write RWHL for short. The RWHL has a wide range of application, it is both a 
model for storage systems and a model for queueing systems. For more details, one can 
refer to [171 Chapter 3]. 

If r(— oo, 0) > 0, then the RWHL is 5o-irreducible and all compact sets are petite. By 
considering the motion of the chain after it reaches {0}, we see that it is also ^-irreducible, 
where 

if) (A) = p "(°> A ) 2 ~ n ' A E B ( x )- 

n 

According to [T7J Proposition 4.2.2], if) is the maximal irreducibility measure. 

Set f3 = J_ xT(dx). Proposition 9.5.1 in [T7] shows that if (3 > 0, then the RWHL is 
transient. For the geometric ergodicity and algebraic ergodicity of the chain, see [7J [TTj, 
[UJ HHJ. Here, we will first study the geometric transience of the RWHL by using the drift 



condition (2.2). 
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Theorem 4.2. Assume that (3 > and there exists 7 > such that 



,0 

/ exp(— jx)T(dx) < 00. 
J —00 



00 
00 



Then the RWHL is geometrically transient. 

Proof. Set A = {0} G B + (X) and choose W(a;) = exp(— sx), where s G (0,7] is to be 
specified later. Then W(0) = 1 and 

PW(0) = j W(y)P(0,dy) = J exp(-sy)P(0,dy) 

POO 

= exp(-sy)T(dy) + T(-oo,0] 
Jo 

exp(-sy)T(dy) - / (exp(-sy) - 1) T(dy) 
J —00 

< j (ex P (-sy)-l)T(dy) + l. 
Since s h> (exp(— sy) — 1) is decreasing, we get 

/oo 
(exp(-sy) - 1) Y{dy) ->■ -/3 < 0, s | 0. 
-oo 

Thus, we can choose and fix so sufficiently small such that 

/oo 
(exp(-s y)-l)r(dy) = e<0. 
-oo 

Hence we have 

f¥(0)<^ + l<l. (4.1) 
Now set VK(x) = exp(— sqx). Then for x G A c , 



PWjx) - W(ar) 
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(exp(-s y) - 1) T(dy) + (exp(s x) - 1) T(-oo, -x) 

/—x 
(exp(s x) - exp(-s y)) T(dy) 
-00 

< / (exp(-s y)-l)r(dy) = £<0. 



-X 

00 



■00 
00 



Thus, PW(x) < (f + l)W(a;) for all re G A c . Combining this with (4.1), the RWHL is 



geometrically transient according to the drift condition (2.2). □ 



Next, we will investigate the algebraic transience of the RWHL by using the drift 



condition (3.7) 
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Theorem 4.3. Assume that (3 > and there exists some integer £ > 2 such that 

r° 

/ (-x) e F(dx) < oo. 

J — OO 

Then the RWHL is t-transient. 

Proof. Since j3 > 0, there exists x > such that J*^ q yT(dy) =: £ > 0. Set 

V(x) = (cx + a)~ e + 1, 
where a G (0, oo) and c G (0, 1] are to be specified later. Then for x > x , 

PV(x)-V(x) = J (V(y)-V(x))P(x,dy) 

= J ((cy + ay e - (cx + a)~ e ) P(x,dy) 

/oo 
((cy + cx + a)~ e - (cx + a)~ l ) T(dy) + (a~ e - (cx + a)~ £ ) r(-oo, -x] 
■X 

/oo 
((cy + cx + a)' 1 - (cx + a)~ £ ) r(dy) 

/-x 
((cy + cx + a)- £ - (cx + a)~ l ) T(dy) + (a~ e - (cx + a)"') T(-oo, -x] 
■X 

/oo 
((cy + cx + a)~ l - (cx + a) - ') T(rfy) + a~ e 
-x 

< V^(x) ( r (cx + aY-(cy + cx + aY ^ + ^ 

\J-xo (cx + a)(cy + cx + a)* (1 + (cx + a)^) 1 
Let 

„. . (cx + aY - (cy + cx + a)* 

f{c,x,y) = — , x>x ,y>-x . 

(cx + a)(cy + cx + a) 1 (1 + (cx + a) £ ) * 

In the following, we turn to bound f(c, x, y). Note that, for x + y > and — y > 0, 

c/~ 2 (cx + a) e ~ 2 < (cy + cx + a) e ~ 2 (-cy + a)^ 2 , 

since 



log(cx + a) — log(cy + cx + a) = / -dz 

J (a 



"(cx+a) y 
— ( 

' (cy+cx+a) % 



r-cy+a -y 

< l -dz = log(— cy + a) — log a. 

Ja Z 

For y G (— Xo, 0), we then get 

| (cx + a) 1 — (cy + cx + a) | = (cy + cx + a — cy) — (cy + cx + a) 



< —£cy(cy + cx + a) H c y (cy + cx + a — cy) 

<-ecy(cy + cx + aY~ 1 + ^—^c 2 y 2 (cy + cx + aY~ 21 <h 
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For y > 0, we obtain 

| (cx + a) e — (cy + cx + a) e \ = —{cy + cx + a — cy) 1 + (cy + cx + a) 1 



< £cy(cy + cx + a) 



-c 2 y 2 (cy + cx + a) e 2 < tcy(cy + cx + a) e 1 . 



Thus, collecting the above estimates, we arrive at 



\f{c,x,y)\ 



< 



ty , e(e-i)(- y + a y 



+ 



1 {»6(-<d ,o)} + -2 1 {i/6[o,oo)} =: g(y)- 



From this, and noting that J°_ (—y) e T(dy) < oo, we have 



g(y)T(dy) < oo. 



Then by the dominated convergence theorem, we get 
1 f°° (cx + a) e — (cy + cx + af 



x (cx + a)(cy + cx + a) 1 (1 + (cx + a) e ) 1 



a 2 (l + a l 



c|0. (4.3) 



Therefore, combining (4.2) with (4.3), we can choose and fix Co small enough such that 
for x > xq, 

a 2 fl + a0 1_ 2 ^ 



PV(x)-V(x) < -tV l -^(x) 



Hence we can also choose and fix ao sufficiently small such that 

PV(x) -V(x) < -iV^^x), x>x . 

Since V(x) is bounded for all x > 0, it is obvious that PV(x) < d < oo for x < x . 
Set A — [0, Xq] and 

sx + 1 

Similarly, we can specify the constant s > 0, and prove PW(x) < W(x)1a"(x) + 61a(^) 
with b G (0, 1). Then the chain is ^-transient by Theorem 3.6, □ 



4.2 The skip-free chain on Z 



+ 



In this section, we will study the skip-free chain, and give the explicit criteria for geometric 
transience and algebraic transience. For the ergodicity of the skip-free chain, see [21 [151, 
and references within. 



The remainder of the section is organized as follows. In Theorem 4.5, geometric 



transience is studied by using the drift condition (2.2). Through the first return time 



criteria (3.1), the algebraic transience is discussed in Theorem 4.6 Finally, in Theorem 



4.9 we consider the strongly geometric transience and uniformly geometric transience for 
the sub-stochastic skip-free chain. 

Example 4.4. (The skip-free Markov chain). Let P = (pij) be an irreducible stochastic 
transition kernel on X = Z + with = for j — i > 2. 
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For < i < n, define p$ = Y^k=oPnki an d inductively 

n-l (fe) 
F (n) _ i F (i) _ \^ Pn ? k 

,_. Pn,n+1 



(4.4) 



Set 



n j oo 

sup 



,(0) 



Theorem 4.5. 7/eri < oo ; £/ien the skip-free Markov chain is geometrically transient. 



Proof. By Theorem 2.2 we need to construct a solution to (2.2) for some A, b e (0,1). 
Let i 2 

and ft = £ if 1 £^-55, ! -°' <4 ' 5) 

j=i fc=0 Pk,k+l-t<k 



fi 



(o) 



It is obvious that both / and g are decreasing. For i > 0, define two operators 



,(0) 



W) 



/it 



,(0) 



and //,(/) = I — 



Pk,k+iF ] 



(o) 



Then by using the proportional property and P, Theorem 3.1], we get 

SUp Ili(f) < SUp/<(/) <4<ri. 

i>0 i>0 



Thus, combining (4.5) with this inequality, we have 

SUp y = SUp Ili(f) < 4(7i, 
i>0 Ji i>0 



and 



# = folW) < fo sup Hi(f) < 4aJ = Aa 1 



i>0 



(0) 



J'=0 



1/2 



< 4a 



3/2 
1 • 



We now determine A, b and a solution to inequality (2.2). Set g = g/go- Then 



p g(Q) = % \Poo9o + Pm9i) = 1 - Poi{9o ~ 9i)g 
= l-/o^ 1 <l-inf-<l-T L , 

^>0 gi 4<7i 



(4.6) 



26 



and for i > 1, 



i+l 



i-1 fc 



= ft/X^'& = ^o 

J=0 Lfc=0 J: 



y^yj^i(gfc - flfc+i) + Pi,i+i9i+i - Pi,i+i9i + 9i 

_k=0 j=0 



9o 



k=0 j=0 

i-l 



— „ F (o) " ^ Pi > i+lF ' ; ^o) + ft 

i=o Pj,j+i r j j=o Pj,j+i r j 



i-l 



<*' EjWE 



fc=0 



- # Wu-p* 



./:. 



i-l 



T-,(0) fj -1 77.(0) \^ •' ) -I 



3 =o Pjj+iF 3 
U 



(0) + 9o 9i 



(4.7) 



3=0 



I'.i i I 1 'j 



9i fi ~ fi~ ^ ~ • r Ji ~ - / i 

= ft ft < ft - inf — ft < 1 

0o ft ft 



1 



4cxi 



ft- 



Therefore, combining (4.6) with (4.7), g is the nonnegative solution of inequality (2.2) 



with A = 6 = 1 — -r—. Hence the desired assertion follows. 

4(71 



□ 



Next, we will study the algebraic transience by the first return time criteria (3.1). For 
i > and £>1, let r = inf{n > 1 : $„ = 0} and f^ ] = Pi{r = n}. Set 



rn 



oo 

(0) _ An) 



10 



E/. 



i0 ) m i0 



71=1 



n=l 



4^ = 0, 



fc=i 



where F; is defined in (14.41). Set 



Pk,k+1 



Spi-l 77.(0) 

- Z^j=o ^ j 

Theorem 4.6. For £/ie skip-free Markov chain, we have for i > 1 and £ >1, 

i-l i-l 



i>i Y^F 

- Z^i=0 - 1 ; 



1 F (o) 

3=0 ^ j 



(0) 



™i0 



(0) 



3=0 

i-l 



3=1 



(0 



E (*f - 



3=0 



and 



m 



(o) 

00 



Poi£ + Poo, mJ5 = p iO"2 + &n 



Moreover, the chain is transient if and only if £ < 1; £/ie chain is i-transient if and only 
if £ < 1 and 02 < oo. 
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Remark 4.7. By the Stolz theorem, it is obvious that £ < 1 if and only ifY^jLo^^ < °°> 
which is equivalent to the transience by |H Theorem 4-52]. 



Proof. (1) Consider the following equations: 



X ° = > ^PjkXk = Xj - PjO, J > 1- 



(4- 



By the second successive approximation for the minimal nonnegative solution, 

xq = and Xj = mfj , j > 1, (4.9) 



is the minimal nonnegative solution of (4.8). Since YukLoPo k = 1> an d by the induction 
argument F- = ^{ =1 p^iv /Pfc,fc+i, (4.8) can be rewritten as 



x j+i x j 



Pj 



1 f j ~ l 

J- / \^ (m) 

J+ 1 \ m =o 



/ ' / , . _ ^_ F j j) Pio 

Xm+1 X m ) 



,71, Pw+i Phi+ 1 
m=0 



•^i x .i-i) 



Pfc,fc+1 



m=0 fc=j 

i 



fc=i 

,(0) 



-E 

fe=i 

f™ Xi -fV>, j>l. 

For i > 2, summing j from 1 to i — 1 gives 



i-1 



i-l 



X 



4 / --j 



(4.10) 



Since (4.9) is the nonnegative solution of (4.8), according to (4.10), we have mf^ > £. 
On the other hand, set 



i-l 



i-l 



Uo = 0, Ul = £ and Ui = F 3° ] t ~ Yl F i 0) ' 1 - 2 ' 

3=0 3=1 



Then is the nonnegative solution of (4.8). By the minimality of , we get < £. 

" - 1 - Ui for i > 2, and 



,(0) 



Therefore, = £, m i0 



??? 



(0) 

00 



Y2 Poim i° + P °° = Po1 ^ + P °°- 
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Thus, £ < 1 if and only if < 1, which is equivalent to transience by Proposition 
(2) Consider the following equations: 



1.1 



j; 



k^O 



where = . Similarly, = a- 2 , mf^ = £Y^]Jo {f^S^ — d!pj for i > 2, and 



Moreover, by Corollary |2.8| (2), 

E T 0-'-{to<oo}] — POi^i [fro + 1) l{r <oo} ] + Poo =PoiEi [(r + l) £ l {ro<oo} ] +p 00 . 

From this, and noting that there exist constants C\ and c 2 such that 

cimfl < Ei [(r + 1) £ 1 {to<oo} ] < c 2 mS, 

we have E |7q1{t <oo }] < oo if and only if = 02 < 00, which yields the desired 
assertion by Theorem [3^ 2). □ 

Finally, we will study the criteria for strongly geometric transience and uniformly 
geometric transience of the sub-stochastic skip-free chain. 

Example 4.8. (The sub- stochastic skip-free chain). Let P = (pij) be an irreducible sub- 
stochastic transition matrix on X = N with p^ = for j — i > 2, and Y2j>iPij < 1 f or 
some % > 1. 

Let P = (p^) be a stochastic transition matrix on the state space X = X U {0}, where 



Pij 



Pij, i,j£X; 

1, i,j = 0] 

0, i = 0,je X. 



Then is an absorbing state for P. Thus, r defined in (2.19) is just the first hitting time 
of state for P, say %. For i > 1, define 



1 F {k) d 
d — 0, di — > — - — and d = sup — ^ — ^ 

Let 



.1 



n-l 

" 1 ' j= n fjj-t-J.-* j 

Following the argument of single-birth processes in [21] or j2[ Theorem 4.52], we can derive 
that there exists a constant k > 1 such that for all i > 1, 



Tti — -L LXJ ^ TL 

sup E F fc (0) E —-r and a 4 = sup ^ (f^ } rf - 4j • 

n - L k=0 j=n Pj,3+l p j - U k=0 



E,k t = EiK 7 * < OO 
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provided 03 < 00, which also implies that 

Pi {r < 00} = Pi {?o < 00} = 1, z > 1. 

Meanwhile, 

SUp EjT = SUp EjT < 00 
i>l i>l 

if and only if cr 4 < 00. Therefore, we have the following criteria according to Theorems 



2TTJ2) and [2l5| 5). 



Theorem 4.9. (1) The chain $ is strongly geometric transient if 0-3 < 00. 
(2) The chain $ is uniformly geometric transient if and only if o\ < 00. 
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